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(54) Network content distribution control 

(57) Content distribution control over a network in 
an electronic distribution system protects the content 
copyright while distributing content In a fonnat enabling 
viewing and enjoyment atthe usertemiinal. The method 
for controlling content distribution over a networic com- 
prises generating content in a first format specification 
by adding content identification data for identifying spe- 
cific content to data produced in a first fomiat specifica- 
tion for viewing; sending the content to a networic; re- 



ceiving the content via the network; separating the re- 
ceived content Into the content identification data and 
the data in the first format specification; converting the 
separated data in the first fomfiat specification to data in 
a different, second fomiat specif k»tion; generating con- 
tent in a second fomnat specification by adding the sep- 
arated content identification data to the data converted 
to the second format specification; and then sending the 
content in the second format specification to a user ter- 
minal. 



Fig.l 



CM 
< 
00 

o 

00 



o. 

LJ 



COMMUNICATION 
NETWORK 4 



CONTENT 
SERVER 




RELAY 
SERVER 



h 


USER 




TERMINAL 




1 



10 



BEST AVAILABLE COPY 



Printed by Jouve, 75001 PARIS (FR) 



EP1 187 048 A2 



Description 

BACKGROUND OF THE INVENTION 

5 FIELD OF THE INVENTION 

[0001 ] This Invention relates to controlling an electronic distribution system for distributing digital multimedia content, 
including audio and video, by way of a networic. 

10 DESCRIPTION OF RELATED ART 

[0002] Fig. 7 shows a prior art electronic distribution system 1 00, which as shown in the figure has plural user ter- 
minals 101 and 102 and a content-owner tenninal 103. The plural user temninals 101 and 102 and content-owner 
temninal 1 03 are connected to a common networic 1 04, such as the Intemet, whereby they can communicate with each 
IS other. 

[0003] When content is conventionally distributed using this electronic distribution system 100, the content owner 
loads a catalog of the available content onto a web site and solicits users wanting the content. When a user provides 
credit card infomiation to pay for desired content, the electronic distribution system 100 verifies the credit card infor- 
mation to authenticate the user, and then delivers the requested content to the user. 

20 [0004] More specifically, the content owner publishes a directory of the content that is available for distribution and 
malces the directory accessible via the network 104. The published directory is a catalog containing at least titles, 
content summaries and price infonmation that is uploaded to a web site on the content-owner temninal 1 03. When a 
user of a user terminal 101 wants to obtain particular content, the user connects to the network 104 using the user 
terminal 101 and accesses the web site where the desired content is located either by using a search engine site to 

25 find the web site address or inputting the web site address found from a magazine, for example. If the summary and 
price of the desired content found in the catalog on the web site are acceptable to the user, the user sends his credit 
card number and other infomiation to the content-owner tenninal 103. If the content owner successfully verifies the 
credit card infomnation, the content-owner tenninal 103 sends the content to the user terminal 101 . 
[0005] The technology described above is described in United States Patent 6,055,51 3, "Method and Apparatus for 

30 Intelligent Selection of Goods and Services in Telephonic and Electronic Commerce." 

[0006] A problem arises with this prior art electronic distribution system 1 00 when the specifications of the distributed 
content differ from the specif k^ations of content that is viewable on the user's terminal or monitor, resulting in the user 
being unable to enjoy the content. This problem occurs, for example, when the content-owner tenninal 1 03 distributes 
content in the high definition TV (HDTV) format but the tenninal on the user terminal 101 , 102 side can only display 

35 content in the standard definition TV (SDTV) format. 

[0007] Another problem with this prior art electronic distribution system 1 00 is that It is not possible to prevent illegal 
copying of content. More specifically, it is not possible to prevent the user of a user temninal 1 01 from loading purchased 
content to the user's own web site without the permission of the content owner so that a third party (such as the user 
of user tenninal 1 02) can copy the content from the first user's web site either for a fee or for free. This act subjects 

40 the producer and legal owner of the content to significant loss of income and is piratical. 

SUMMARY OF THE INVENTION 

[0008] An object of this invention is therefore to provide an electronic distribution system that can protect the copyright 
45 of the content and also provide content in a fomnat that can be viewed on the user tenninal. 

[0009] To achieve these objects, a method according to the present invention for controlling content distribution over 
a network has steps of generating content in a first fomnat specification by adding content Identrfbation data identifying 
specific content to data produced In a first fomnat specification for viewing; sending the content to a communication 
network; receiving the content via the communication network; separating the received content into the content iden- 
50 tif ication data and the data In the first fomnat specification; converting the separated data in the first fomnat specification 
to data in a second fomnat specification that is different from the first format specification; generating content in a 
second fomiat specification by adding the separated content identification data to the data converted to the second 
fomnat specification; and sending the content in the second fonnat specification to a user terminal. 
[0010] The objects of the invention can also be achieved by writing the content distribution control method of the 
55 invention as a computer-executable content distribution control program. 

[0011] These objects can yet further be achieved with a recording medium storing this content distribution control 
program. 

[0012] Yet further, the objects of the invention can be achieved with a system according to the present invention for 
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controlling content distribution over a network, the system having a first identification data adding unit for generating 
content in a first format specification by adding content Identification data for identifying specific content to data pro- 
duced in a first fonmat specification for viewing, and then sending the content to a communication networic; an identi- 
fication data separating unit for receiving the content from the first Identification data adding unit via the communication 

5 network, and separating the received content into the content identification data and the data in the first format spec- 
ification; a converter for converting data in the first format specification separated by the Identification data separating 
unit to data in a second fomnat specification that is differentfromthefirstformat specification; and asecond identification 
data adding unit for generating content in a second fomnat specification by adding the content identification data sep- 
arated by the identification data separating unit to the data to the data converted to the second format specification by 

10 the converter, and then sending the content In the second format specification to a user terminal. 

[0013] By converting content from a first fonmat specif feation to a second format specification and sending the refor- 
matted content to a viewer (user) temnlnal, the content distribution system of the present Invention enables a user to 
enjoy content in the format of a display device that is different from the specifications of the user temnlnal. 
[001 4] In addition, by adding the identif teatlon data Inserted to content in tiie first format specification to the content 

15 converted to the second fomnat specification, the rights of the content owner can be protected even after the fomnat of 
the content has been changed. 

[001 5] Yet further, content ID appropriate to content in the second fomnat specification can be achieved by converting 
the content ID extracted from content In the first format specification according to the conversion to the second fomnat 
and then adding the converted content ID to the content In the second format. 
20 [0016] A drop in the quality of content in the second format can also be prevented by converting content from the 
first to tfie second fomnat after removing the content ID from the content In the first fomnat. 

[001 7] Other objects and attainments together with a fuller understanding of the invention will become apparent and 
appreciated by referring to the following description and claims taken in conjunction with the accompanying drawings. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

[001 8] These and other object and features of the present Invention will become clear from the following description 
taken in conjunction with the prefen-ed embodiments thereof with reference to the accompanying drawings, in whbh: 

30 Fig. 1 is a diagram showing the configuration of a content distribution system according to a preferred embodiment 

of the present invention; 

Fig. 2 is a block diagram showing a specif k: configuration of this content distribution system; 
Fig. 3 is an example of content identification data; 
Fig. 4 is an example of a catalog containing plural catalog data entries;* 
35 Fig. 5 Is an example of an Identification data table; 

Fig. 6 Is the concept of the format conversion process; and 
Fig. 7 Is a prior art electronic distribution system. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

40 

[001 9] The preferred embodiments of the present invention are described below with reference to the accompanying 
figures wherein parts having the same reference numeral also have the same function. 

[0020] Fig. 1 shows the configuration of a content distribution system 1 0 according this preferred embodiment of the 
invention. Content distribution system 1 0 has a user temninal 1 , relay server 2, and content server 3. The user terminal 

^ 1, relay server 2, and content server 3 are each connected to a communication network 4, such asthe I ntemet, through 
which they can communicate with each other. With content distribution system 1 0, the content server 3 provides the 
content available for distribution (selling) on the relay server 2. Users can view the content published on the relay 
server 2 and purchase the desired content. User purchase requests are sent to the content server 3. The content server 
3 then sends the requested content to the relay server 2 In a first fomnat specification. The relay server 2 converts the 

so content received from the content server 3 in the first format to a second fomnat specification, and sends the reformatted 
content to the user temninal 1 . It will be obvious to one with ordinary skill in the related art that while only one user 
terminal 1 Is shown in the figure, plural user terminals can be connected. 

[0021] The configuration of this content distribution system 1 0 Is described in greater detail with reference to Fig. 2. 
Fig. 2 is a block diagram showing a specif k: configuration of the content distribution system 1 0. Note that for convenience 
55 the communication networic 4 is not shown. This configuration is described next in conjunction with data flow. 

[0022] The content producer first produces audio and/or video (AV) data (multimedia data) according to a particular 
digital specification. This multimedia data is what the user views and listens to, and is commonly and herein refen^ed 
to as "content." It will also be noted that muitimedia data to which content identification data (hereinafter referred to as 
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" content ID" and further described below) has been added for copyright protection is also referred to herein as content, 
it wilt be further noted that "data" when used aione means multimedia data to which content ID has not been added. 
[0023] The content producer is typically the copyright holder. The content could be only video or only audio. In order 
to distribute content, the copyright holder sends the content from the copyright holder terminal 20 to the content server 
5 3. The copyright holder tenninal 20 is a computer tenninal whereby the copyright holder transmits data. The copyright 
holder terminal 20 and content server 3 could be the same computer. 

[0024] The content server 3 has a content identification data generating unit 31 and a content identification data 
appending unit 32 (hereinafter refen^ed to as "content ID generating unit 31" and "content ID appending unit 32", re- 
spectively). The content ID generating unit 31 generates the content ID according to a specified process. The content 

10 ID is uniquely and uniformly assigned in order to identify the content. 

[0025] Fig. 3 shows an example of the content ID. As shown in Fig. 3, the content ID preferably contains the following 
information in a specified format: a copyright holder identifier, content identification code, content recording date, who 
recorded the content, title, genre, content type, duplication fee, and a contact address for the buyer 
[0026] The copyright holder identifier is uniformly and uniquely assigned to each copyright holder, and enables the 

15 owner of the copyright to the content to be identified. The copyright holder identifier is transmitted with the content from 
the copyright holder temninal 20 sending the content, or the sender is identified by the content server 3. 
[0027] The content identification code is a unique value, and is added when the content is commercial content pro- 
duced by a production company or other content creation company for resale purposes. The content identification code 
of content 2 in Fig. 3 is AAAB. The content ID generating unit 31 (Fig. 2) generates the content identification code 

20 using not only the content creation date, but also the hour, minute, second, and even millisecond data as parameters. 
If it is desirable to uniquely Identify content 2 woridwide, the producer can apply to an organization for assigning iden- 
tification codes that are common woridwide and ask for the unique content identification code AAAB for use with the 
particular content. As will be further described below, this content identification code and copyright holder identifier can 
be used to determine if content is an illegal copy. 

25 [0028] The name of the recorder, title, and other information is input by the producer. 

[0029] Returning again to Fig. 2, the content ID appending unit 32 embeds the content ID generated by the content 
ID generating unit 31 as a digital watennark in the content received from the copyright holder terminal 20. 
[0030] A digital watemnark is characterized primarily in that the digital watemiark is not lost when the copyrighted 
material (audio or video) is edited or compressed or expanded; is embedded at a level that is not detectable to the 

30 human eye or ear; and the original quality of the copyrighted material is maintained even when a digital watennaric is 
embedded. The content ID is thus integral to and inseparable from the content, overwriting the content ID can be 
prevented, and the content ID can be used to control playback and recording of the content. 
[0031] Various methods can be used to embed a digital watermaric. One method is to randomly add the digital wa- 
termark data to a specific frequency component of the content. More specifically, the signal containing embedded 

35 digital watermark data is 

ai + xi * cl (1) 

4a where ai is the specific frequency component of the content where the digital watermark is inserted, ci is a random 
value of +1 or -1 , and xi is the value of the content ID that is embedded as the digital watennark. 
[0032] This results in content having the content ID superimposed as a digital watermaric on the content. It will also 
be obvious that when the content ID is superimposed as digital watennaric data to the content from the copyright holder 
tenninal 20, the content ID can be encrypted before being superimposed. In this case the value of xi in equation 1 is 

45 the value of the encrypted content ID. Either the content ID generating unit 31 or the content ID appending unit 32 can 
process the encryption. Using encrypted content ID as the digital watermark data also makes unauthorized decryption 
of the information by a user more difficult and thus more reliably protects the copyright. 

[0033] The content server 3 then generates and sends catalog data for the content to the relay server 2 in order to 
maricet the content to a wider audience. The catalog data could contain previews of content highlights, a copyright 

50 notice, the title, content type, price, and where to contact to purchase the content. 

[0034] Retening again to Fig. 2, the relay server 2 is a server computer accessible from the network and storing a 
compiled catalog of plural catalog data entries. If the content contains video, the relay server 2 preferably enables the 
content highlights to be previewed. If the content is audio (music), a selection of a particular length could be provided 
as a preview. The copyright notice and warning about illegal act of copying is likewise displayed. 

55 [0035] A sample catalog compiling plural catalog data entries is shown in Fig. 4. The catalog can be posted to a 
common bulletin board (electronic bulletin board) accessible from the network. Users can then select desired content 
by accessing the bulletin board on the relay server 2 and viewing the catalog. It should be further noted that the content 
ID is also contained in the preview data extracted from the content. 
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[0036] The configuration of tlie relay server 2 is described next. As shown in Fig. 2, the reiay server 2 has an iden- 
tification data extraction unit 21 (herein after referred to as "ID extraction unit 21"). identification data table 22 (hereinafter 
refen-ed to as "ID table 22"), verification unit 23, catalog data storage unit 24, bulletin board 25, identification data 
separation unit 26 (hereinafter referred to as "ID separation unit 26"), format converter 27, and identification data 
5 appending unit 28 (hereinafter referred to as "ID appending unit 28"). 

[0037] The ID extraction unit 21 extracts the identification data added to the content from the preview part used in 
the catalog data. The identification data referred to here is the copyright holder Identifier ([10001], [10054] in Fig. 4) 
and the content identification code (AAAB in Fig. 4), that is, the digital watermark data added randomly to the specltic 
frequency component. 

10 [0038] The specific method of extracting the identification data is described below. That is, the content is first passed 
through the same bandpass filter used to insert the digital watermark to extract the frequency component where the 
identification data is embedded. The same random number used for digital watemnaric Insertion is multiplied with the 
frequency component, and the result is passed through a filter for extracting only the DC component. As described 
above with reference to equation 1 , the signal containing embedded digital watennaric data can be written as [ai + xi 

15 * cil where ai is the specific frequency component of the content where the digital watemnaric is inserted, ci is a random 
value of +1 or -1 , and xi is the value of the content ID that is embedded as the digital watermaric. The value after the 
ID extraction unit 21 is multiplied by random number ci is therefore 

^ (al + xi*ci)*ci = ai*cl+xi*(cl^2) (2) 

[0039] When public key encryption is used random number ci is encrypted using the public key and sent only to the 
relay server 2 and the user terminal of the authorized user. The relay server 2, for example, then decrypts random ci 
using a unique secret (private) key. More specifically, random number ci is +1 or -1 , so the DC component of ai*ci is 0 
25 and cf^2 = 1 . Filtering this signal with the dc component extraction filter results in (ai + xi * ci) * ci = xi, and the identification 
data embedded as the digital watermaric can be extracted. 

[0040] If the content ID used as the digital watemnaric was first encrypted, a key is needed for decryption. This key 
can be obtained from the content server 3. The ID extraction unit 21 uses this key to decode the content ID. If public 
key encryption Is used, the public key used for encryption and the private key used for decryption are both required. 
30 [0041] The Identification data can altemativety be encrypted as (xi + ci) where ci is randomly +1 or -1 and xi is the 
value of the content ID used as the digital watemnaric and (+) indicates an exclusive OR. By adding ci to xi+d, the result is 

(xi + d) + ci = xi + (ci+ci) = xi + 0 = xi (3) 

35 

and the ID extraction unit 21 can extract the identifteation data. As noted above, the random number ci Is sent only to 
the relay server 2 and user temninal of an authorized user using pubfic key encryption. 

[0042] It will also be noted that encryption and decryption using the copyright holder identifier can also be accom- 
plished by multiplying the copyright holder identifier and a random number or other method. 
40 [0043] The ID table 22 stores the copyright holder identifier and content identification code as a set. Fig. 5 shows 
an example of the ID table 22. The infomnation stored to the ID table 22 is the content ident'rfication code and copyright 
holder identifier infomnation used in the c:atalog data that is sent from the content server 3 before the catalog data is 
sent to the relay server 2. 

[0044] The verification unit 23 shown in Fig. 2 verifies if the combination of copyright holder Identifier and content 
45 Identification code extracted by the ID extraction unit 21 is correct. More specifically, the verifk^ation unit 23 (compares 
the copyright holder identifier and content identification code combination extracted by the ID extraction unit 21 with 
the copyright holder identifier and content Identification code combinations stored in the ID table 22, and if a match is 
found knows that the content is not an illegal copy. This means that the verifteation unit 23 detemiines whether the 
catalog data and further the content sent from the content server 3 is information that was sent by the copyright holder. 
so If the combination is confirmed to be legal, the verification unit 23 allows the catalog data storage unit 24 to store the 
catalog data. The catalog data storage unit 24 then stores the catalog data sent from the content server 3. Distribution 
of the content is thus allowed, and the content catalog is posted to the bulletin board 25. The catalog shown In Fig. 4 
contains content 1 and content 2. 

[0045] The verification unit 23 detects an illegal copy if the combination of copyright holder identifier and content 
55 identification code extracted by the ID extraction unit 21 does not match a combination stored in the ID table 22, or if 
the content ID is not detected, and the catalog data is therefore not posted to the bulletin board 25. This is because 
there is a high probability that it is an illegal copy of existing commercial content. In this case the user requesting that 
the content be posted (the user temninal of the general user that made the illegal copy, for example) is notified that the 
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content will not be posted. This results in illegally copied content not being posted to the bulletin board 25. To forcefully 
protect against illegal copying, the legal holder of the content copyright could also be notified that there was an attempt 
to load an illegal copy of the copyrighted content, tt will be noted that by polling the organization assigning common 
identification codes worldwide to confimn whether a copyright holder identifier and content identification code combi- 

5 nation is conrect, the verification unit 23 can detennine the authenticity (legality) of the identification data. 

[0046] The user terminal 1 is described next. The user terminal 1 Is the tenninal or computer whereby a user views 
the bulletin board 25 containing the catalog data, views previews of content from the catalog data on the bulletin board 
25, and views or listens to the content. If there is content that the user wishes to purchase, the user sends a purchase 
request to the content provider (marketer or copyright holder of the content on the content server 3). This request 

10 contains the e-mail address or other infomnation specifying the content provider or other party marketing the content. 
When the content server 3 receives such a purchase request. It sends a request for credit card information, electrons 
money, or other payment method to the user terminal 1 . The content server 3 also requests the format supported by 
the user temninal 1 for viewing the content. 

[0047] When the credit card infomnation and fomnat supported by the user terminal 1 is received, the content server 
IS 3 verifies the credit card infomnation, electronic money, or other payment infonnation, and then sends the content 
desired by the user to the relay server 2. If the fomnat of the content received from the content server 3 is the same as 
format specified by the user, the relay server 2 simply sends the content directly to the user temninal 1 . 
[0048] If the fomnat of the content sent to the relay server 2 differs from the format required by the user temninal 1 , 
the relay server 2 converts the received fonmat to the fonmat viewable by the user terminal 1 , and then transmits the 
20 content to the user terminal 1 . The tenm " viewable" means that the user terminal 1 supports the fomnat in which the 
content will be reproduced, or can display the content at the perfomnance of the output display (the display performance 
of the monitor) of the user terminal 1 . This process is run primarily by the ID separation unit 26, format converter 27, 
and ID appending unit 28. 

[0049] The primary steps of the process of this invention for format conversion are described next with reference to 
25 Fig. 6. While the fomnat specification includes the encoding method, resolution, and other parameters, a process for 
converting content in MPEG-2 main profile, high level forniat (such as HDTV fonmat) to content in MPEG-4 simple 
profile, level 0 fomnat (such as Quarter Common Intemnediate Fomnat (QCIF)) Is used by way of example. This con- 
version process enables the user to view content using a cellular phone or other user temninal 1 on which content 
cannot be viewed in the normal TV fomnat. 
30 [0050] Fig. 6 shows the concept of this format conversion process, which is described in sequence below. The cop- 
yright holder produces MPEG-2 main profile, high level AV data conforming to the HDTV fomnat, and sends this data 
to the content server 3. The content ID appending unit 32 of the content server 3 generates content in first fomnat by 
adding content ID as a digital watemnaric encrypted using a public key encryption scheme to the AV data. The content 
server 3 sends content in this first fonmat to the relay server 2. 
35 [0051 ] Using the private decryption key, the ID separation unit 26 of the relay server 2 separates the content ID from 
the content, and thus extracts the content and the content ID. More specifically, it separates the content ID from the 
content fomnatted to this first fomnat specification. The AV data is then obtained by subtracting the content ID from the 
first fomnat data. 

[0052] It should be noted that the process described below can continue by simply extracting the content ID from 
40 the content without completely separating the content ID and AV data. In this case, however, plural different digital 
watermarics will be added to the content, and content quality will likely deteriorate. 

[0053] The fonmat converter 27 then downsampies the MPEG-2 main profile, high level fonmat AV data obtained by 
the ID separation unit 26 to MPEG-4 simple profile, level 0 format AV data. Using the procedure described above for 
adding a digital watemnaric, the ID appending unit 28 of the relay server 2 then adds the extracted content ID to the 
45 converted AV data to output data fomnatted to the second fomnat specification. The ID appending unit 28 sends the 
reformatted content to the user temninal 1 (Rg. 1). 

[0054] It will be noted that the extracted content ID is re-inserted to the refonmatted content as the digital watermaric 
without modification in the above example. It will be obvious, however, that the format converter 27 could delete or 
modify part of the content 1 D before inserting it as the digital watermaric to the AV data. For example, the original content 

50 ID could contain infomnation indicating that the content is formatted to the first fomnat specifteation, and the fonmat 
converter 27 could modify the content ID inserted to the AV data to Indicate that content has been reformatted to the 
second format specification. In this case it will still be possible to determine that content was illegally obtained even if 
a third party refomnats the content because the digital watermark cannot be changed by a third party and the content 
ID (digital watemnark) will still contain infonmation indicating the first fonmat specification even though the content has 

55 been refonmatted to the second specification. 

[0055] It will also be obvious that different methods and encryption keys can be used to add or insert the digital 
watermaric data. 

[0056] It will also be obvious that while conversion from an MPEG-2 main profile, high level fonmat to the MPEG-4 
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simple profile, level 0 format is described above, the invention shall not be so limited as other conversions wilt also be 
possible. Irrespective of whether the content is moving picture data or still image data, conversion from one fomnat to 
another fomnat such as shown in the following Table 1 Is possible. 

5 Table 1 



Content Type 


Format 


Application, features 


Video 


MPEG-2 video, main profile, high level 


HDTV High Resolution 




MPEG-2 video, main profile, main level 


Standard TV Medium Resolution 




MPEG-1 video 


PC, karaoke 




MPEG-4 video, simple profile, level 0 


Cellular phone display 




MPEG-4 video, core profile, level 2 


PC, Intemet 




ITU-T H.26L 


Telephone 




ITU-T H.263 


Wire telephony 




ITU-T H.261 


Wire telephony 




Windows Media Video 


PC, Intemet 




Real Video 


PC, Intemet 




Motion JPEG 


Cameras 




Motion JPEG 2000 


Cameras (future) 


Still Image 


JPEG 


Cameras 




JPEG 2000 


Cameras (future) 




GIF 


PC 



30 Format conversion is possible, for example: 

* between different moving picture (video) fomnats (such as from a MPEG-2 video, main profile, high level format to 
a MPEG-2 video, main profile, main level format); 

* between different still image fomnats (such as from JPEG to GIF); 

35 * from a video fomnat to a still image format (such as from a MPEG-2 video, main profile, high level fomnat to the 
JPEG 2000 format); and 

* from a still image fomnat to a video fomiat (such as from still images in plural JPEG formats to a motion JPEG 
fomnat, or converting plural GIF format still images to a frame interpolated MPEG-1 video fomnat). It will be noted 
that the fomnats shown in the above table are known from the literature, and description of specific conversion 

40 algorrthnns is therefore omitted. 

[0057] As described above, the relay server 2 can generate content containing a digital watemnark and in a format 
that is viewable on the user terminal 1 . The content can then be sent to the user terminal 1 so that the user can enjoy 
viewing the content while simultaneously appropriately protecting the copyright of the content owner. 
^ [0058] The configuration of the user temninai 1 is described next. The user terminal 1 could be a personal computer, 
cellular phone, or television or video deck having a communication function. The user terminal 1 has an identification 
data extraction unit 11 (hereinafter referred to as "ID extraction unit 11"), verification unit 12, recorder 13, and playback 
unit 14. 

[0059] When receiving content in the second fomnat from the relay server 2 begins, the ID extraction unit 11 of the 
50 user temninai 1 reads the content ID embedded in the content. It will be noted that only part of the content is received 
at this time. Based on the read identification data, the verification unit 12 then confimns the authenticity of the content 
using the same method used by the verifteation unit 23 of the relay server 2. If the content Is verified, the verifkxatlon 
unit 1 2 permits recording the content to the recorder 1 3. 

[0060] If content verification fails because the received content is not an authorized copy, for example, or the content 
55 ID is not detected, receiving the content is stopped. It will also be obvious that the verification unit 12 could verify the 
content after reception is completed. If verification fails in this case, the verification unit 12 prevents the playback unit 
14 from reproducing and outputting the content, and thus prevents the viewer from seeing the content output on the 
display. This means that even if a user completely downloads an illegal copy to the user's temninai. the content will not 
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be presented. The copyright is therefore protected. 

[0061 1 As will be known from the preceding description of the present invention, the relay server 2 converts the format 
specification of the content from a first format to a second fomiat if the fomiat (first fornnat specification) of the content 
stored on the content sender 3 is not the same as the fomiat (second fomnat specification) required for viewing on the 
user temriinal 1. This assures that the user of the user terminal 1 can enjoy the content. In addition, the content ID 
inserted as a digital watermark to the content of the first fomnat is not lost and is also contained in the content after 
conversion to the second format. The content ID contains a copyright holder identifier enabling the content owner to 
be identified, and a content identification code identifying the content. Whether content is an illegal copy can be de- 
temnined based on the content ID, and the copyright of the content owner can therefore be simultaneously protected. 
[0062] In the preferred embodiment of the invention described above the content ID appending unit 32 of the content 
servers inserts the content ID to the AV data sent from the copyright holder. This operation can, however, be performed 
by the relay server 2. In this case the content server 3 sends the content and the content ID to the relay server 2. The 
relay server 2 could also fetch or generate the content ID. 

[0063] The format converter 27 of the relay server 2 also converts content from a first format specification to a second 
fonnat specification, but a conversion program could be contained in the user terminal 1 for conversion to the desired 
fomiat specification. 

[0064] Purchase requests are also sent directly from the user terminal 1 to the content server 3 in the above em- 
bodiment, but could also be sent through the relay server 2 to the content server 3. In this case the content server 3 
only processes requests received from the relay server 2, thus simplifying management. 

[0065] The processing operations of the various components of the above described content distribution system can 
also be written as a computer program causing a computer to execute the various processes. Such a computer can 
be recorded to a CD, DVD, or other optical disc, to a floppy disk or other magnetic storage medium, or to flash memory 
or other semiconductor storage medium. The computer program could yet further be distributed as an electric signal 
via the Internet or other networi<. 

[0066] Although the present invention has been described in connection with the preferred embodiments thereof 
with reference to the eiccompanying drawings, it is to be noted that various changes and modifications will be apparent 
to those skilled in the art. Such changes and modif cations are to be understood as included within the scope of the 
present invention as defined by the appended claims, unless they depart therefrom. 



Claims 

1 . A method for controlling content distribution over a network, the method comprising: 

generating content in a first fomiat specification by adding content identification data for identifying specif k: 
content to data produced in a first format specifbation for viewing; 
sending the content to a network; 
receiving the content via the networic; 

separating the received content into the content identification data and the data in the first format specif cation; 
converting the separated data in the first format specif cation to data in a second fomiat specification that is 
different from the first fonnat specif cation; 

generating content in a second fomnat specification by adding the separated content identification data to the 

data converted to the second fomiat specification; and 

sending the content in the second fomnat spedfcation to a user terminal. 

2. A method for controlling content distribution as described in claim 1 , wherein: 

the content identification data contains infomnation indcating the content format; and 

the converting comprises converting the infomnation indicating the content format according to the conversion 

of data from the first format specification to the second fomnat specification. 

3. A method for controlling content distribution as described in claim 1 , wherein the separating comprising: 

obtaining the content identification data from the content; and 

obtaining the data in the first format specif cation by subtracting the obtained content identif cation data from 
the content. 

4. A method for controlling content distribution as described in claim 1 , further comprising in the user temninal: 
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extracting the content identification data from content in the second fonnat specification; and 
reproducing the content in the second fonnat specification if the content identification data is correctly extract- 
ed. 

5 5. A system for controlling content distribution over a network, the system comprising: 

a first Identification data adding unit for generating content in a first fonmat specification by adding content 
identification data for Identifying specific content to data produced in a first fonnat specification for viewing, 
and then sending the content to a networic; 
10 an identification data separating unit for receiving the content from the first identification data adding unit via 

the network, and separating the received content into the content identifk^tion data and the data in the first 
fomnat specification; 

a converter for converting data in the first format specification separated by the Identif cation data separating 
unit to data in a second fonnat specifbation that Is different from the first format specification; and 
15 a second Identif cation data adding unit for generating content in a second fonnat specification by adding the 

content Identification data separated by the identification data separating unit to the data to the data converted 
to the second fonnat specification by the converter, and then sending the content in the second fonnat spec- 
ification to a user terminal. 

20 6. A system for controlling content distribution as described in claim 5, wherein: 

the content identification data contains infonnation indicating the content format; and 

the converter also converts the information indk:ating the content fonnat according to the conversion of data 

from the first fonnat specification to the second fonnat specification. 

25 

7. A system for controlling content distribution as described In claim 5, wherein: 

the Identification data separating unit obtains the content identif cation data from the content, and separates 
the content identif cation data and the data to be viewed by subtracting the obtained content Identif batlon data 
30 from the content. 

8. A system for controlling content distribution as described In claim 5, wherein: 

a content sender having the first identif cation data adding unit and receiving data to be viewed produced in a 
35 first fomnat specification from a data creator terminal, 

a relay server having the identification data separating unit, converter, and second Identif cation data adding 
unit, and 

a user terminal for receiving content In the second format specification from the second identification data 
adding unit of the relay server, are connected to the networic. 



40 



9. A system for controlling content distribution as described in claim 5, wherein: 



the user tenninal extracts the content identification data from content In the second fomnat specification, and 
reproduces the content in the second format specification If the content identification data is correctly extracted. 

45 

10. A computer-executable program for controlling content distribution, the program comprising: 

generating content in a first format specification by adding content identification data for identifying specif c 
content to data produced In a first fonnat specif cation for viewing; 
50 sending the content to a network; 

receiving the content via the networic; 

separating the received content into the content identification data and the data In the first format specif cation; 
converting the separated data in the first fonnat specification to data in a second fonnat specification that Is 
different from the first format specification; 
55 generating content in a second fonnat specification by adding the separated content Identification data to the 

data converted to the second fonnat specification; and 
sending the content In the second format specification to a user tenninal. 
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11. A computer-executable program for controlling content distribution as described in claim 10, wherein: 

the content identification data contains infomnation indicating the content fomaat; and 
the converting comprising converting the infomnation indicating the content format according to the conversion 
5 of data from the first fomiat specification to the second fomiat specification. 

12. A computer-executable program for control ling content distribution as described In claim 1 0, wherein the separating 
comprises: 

10 obtaining the content identification data from the content; and 

obtaining the data In the first format specification by subtracting the obtained content Identification data from 
the content. 

13. A computer-executEible program for controlling content distribution as described in claim 10, further comprising in 
15 the user temninal: 

extracting the content identification data from content in the second fomiat specification; and 
reproducing the content in the second fomnat specification if the content identification data is correctly extract- 
ed. 

20 

1 4. A recording medium for recording a computer-executable program for controlling content distribution as described 
indaim 10. 

15. A method for relaying content distributed over a networic, the method comprising: 

25 

receiving content via the network, where the content is generated in a first fomnat specification by adding 
content identification data for identifying specific content to data produced in a first fomnat specification for 
viewing; 

separating the received content into the content identification data and the data in the first fomnat specification; 
30 converting the separated data in the first format specification to data in a second fomnat specification that is 

different from the first fomnat specification; 

generating content in a second format specification by adding the separated content identification data to the 

data converted to the second fomnat specification; and 

sending the content in the second format specification to a user terminal. 

35 

16. A method for relaying content distributed as described in claim 1 5. wherein the content identification data contains 
information indicating the content format and the converting Includes converting the content identification data 
according to the conversion of data from the first format specification to the second fomiat specification. 
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